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Malaria is a disease caused by plasmodium parasites transmitted through the 
bites of female anopheles-mosquito that infect the human red blood cell 
(RBC). The standard malaria diagnosis is based on manual examination of a 
thick and thin blood smear, which heavily depends on the microscopist 
experience. This study proposed a system that can identify the life stages of 
plasmodium falciparum in human RBC. The image preprocessing process 
was done by illumination correction using gray world assumption, contrast 
enhancement using shadow correction, extraction of saturation component, 
and noise filtering. The segmentation process was applied using Otsu 
thresholding and morphological operation. The test results showed that the 
use of artificial neural network (ANN) using a combination of texture and 
morphological features gives better results when compared to the use of only 
texture or morphology features. The results showed that the proposed feature 
achieved an accuracy of 82.67%, a sensitivity of 82.18%, and a specificity of 
94.17%, thus improving decision-making for malaria diagnosis. 


This is an open access article under the CC BY-SA license. 


Corresponding Author: 
Retantyo Wardoyo 


Department of Computer Sciences and Electronics, Universitas Gadjah Mada 
55281 Building C, 4 Floor, North Sekip, Bulaksumur Yogyakarta Indonesia 


Email: rw @ugm.ac.id 


1. INTRODUCTION 


Malaria is a disease caused by plasmodium parasites transmitted by the bites of infected female 
Anopheles mosquito and infect the human red blood cell (RBC). Malaria remains a significant burden on 
global health. In 2018, the World Health Organization (WHO) reported there were 228 million cases of 
malaria that occurred worldwide and an estimated 405,000 deaths from malaria [1]. Typically, the first 
symptoms of malaria are a high temperature of 38 °C or above, headaches, muscle pains, and diarrhea. 
However, these symptoms are often mild and can be challenging to identify as malaria [2]. There are five 
parasites of plasmodium that cause malaria in humans, i.e., plasmodium falciparum, plasmodium vivax, 
plasmodium malariae, plasmodium ovale, and plasmodium knowlesi. Each plasmodium in human RBC has 
three life stages, i.e., trophozoite, schizont, and gametocyte. Plasmodium falciparum and plasmodium vivax 
are the most cause of malaria cases in the world, and the most responsible for global death in the world is 
plasmodium falciparum [3]. Plasmodium ovale causes a not severe infection, while plasmodium malariae can 
cause severe fever, but it does not cause mortality [4]. 
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The standard malaria diagnosis is typically based on a microscopic thick and thin blood smear 
examination. Thick blood smears assist in detecting the presence of parasites, while thin blood smears assist 
in identifying the species of the parasite causing the infection [5]. The diagnostic accuracy heavily depends 
on microscopist skill and can be strongly affected by the inter-observer variability [6]. Therefore, the 
experience and expertise of malaria microscopists are crucial in assuring parasite identification in human 
RBC [7], [8]. Some previous research has developed an automatic system to segment malaria parasites in 
digital microscopic blood smears. Maysanjaya et al. [9] proposed an approach to segment the form of 
parasitic cells of plasmodium vivax using the combination of the red (R) channel in the red, blue, and green 
(RGB) color space and saturation (S) channel in the hue, saturation, value (HSV) color space. These 
two-color channels are then combined to form a grayscale image. The grayscale image is then converted to a 
binary image using the Otsu method and morphological operation. Aggarwal et al. [10] have also used the 
Otsu method to separate the segmented images containing the infected cell from the green channel image. 
The experiment results in an accuracy of up to 93%. 

Many researchers have also researched feature extraction and plasmodium classification. 
Nugroho et al. [11] proposed a technique to classify three stages of plasmodium falciparum, i.e., trophozoite, 
schizont, and gametocyte, then multilayer perceptron backpropagation algorithm is used to classify its life 
stages. The results show that the proposed method achieves an accuracy of 87.8%, specificity of 90.8%, and 
sensitivity of 81.7%. Adi et al. [12] also use backpropagation neural networks to classify the developmental 
phase of plasmodium falciparum using morphological features, i.e., area ratio and eccentricity. In subsequent 
research, Nugroho ef al. [13] can improve the accuracy of the multilayer perceptron method with 
morphological features to classify malaria parasite from a thin blood smear digital microscopic image, and 
the proposed system has an accuracy of 95%, the sensitivity of 93%, and the specificity of 97%. Another 
approach uses a k-nearest neighbor (KNN) classifier based on shape and textural features with an accuracy of 
90.17% and sensitivity of 90.23% [14], while support vector machine (SVM) using only textural features can 
achieve an accuracy of 97.7%, the sensitivity of 97.4%, the specificity of 97.7% [15]. Based on previous 
studies, this paper attempts to detect the life stages of plasmodium falciparum, i.e., ring, trophozoite, 
schizont, and gametocyte on a digital thin blood smear. The proposed method will extract a combination of 
histogram-based texture and morphological features from the image of plasmodium falciparum, then use an 
artificial neural network to classify the life stages of plasmodium falciparum. 


2. RESEARCH METHOD 

The research data is digital microscopic images of thin blood smears infected by the plasmodium 
falciparum parasite, which is obtained from public datasets the malaria parasite image database (MP-IDB) 
[16] and the public health image library (PHIL) centers for disease control and prevention (CDC) [17] as 
shown in Figure 1. Figure 1 shows original thin blood smear images infected with plasmodium falciparum at 
Figure l(a) ring, Figure 1(b) trophozoite, Figure 1(c) schizont, and Figure 1(d) gametocyte stages. These 
images have been acquired using a Leica DM2000 optical laboratory microscope with 100x magnification. 
The image resolution is 2592x1944 px and 24-bit color depth [16]. Figure 2 shows the cropping operation 
from the original thin blood smear image in Figure 2(a) and the region of interest (RoI) containing an 
infected RBC by plasmodium falciparum with resolution 250x250 px in Figure 2(b). 
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Figure 1. Digital microscopic images of thin blood smears infected by plasmodium falciparum (a) ring, 
(b) trophozoite, (c) schizont, and (d) gametocyte [16] 


The number of datasets obtained after the cropping operation is 250 images consisting of 80 images 
of plasmodium falciparum at the ring stage, 65 trophozoites, 35 schizonts, and 70 gametocytes. Figure 3 
shows each sample image from the Figure 3(a) ring, Figure 3(b) trophozoite, Figure 3(c) schizont, and 
Figure 3(d) gametocyte stages. The conducted research consists of five main steps. The first step is image 
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acquisition as described previously, and the examples of resulting images are shown in Figure 3. The 
following steps are image preprocessing, segmentation, feature extraction, and classification, as shown in 
Figure 4. Each of these steps is explained in the following subsections. 


(a) (b) 


Figure 2. Cropping operation (a) original image and (b) Rol of infected RBC by plasmodium falciparum 
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(c) 
Figure 3. Life Stages of the plasmodium falciparum (a) ring, (b) trophozoite, (c) schizont, and (d) gametocyte 


2.1. Preprocessing 

Figures 3(a) to 3(d) shows that each image has different illumination because of the staining 
variability on thin blood smear and different light sources in the camera during the image acquisition 
process [18]. Improper handling of slides can also cause noise, resulting in the low quality of the microscopic 
image [19]. The main objectives of the preprocessing step are to correct illumination, improve image quality 
by adjusting the image contrast, and reduce the noise in the images [4]. The preprocessing stage consists of 
illumination correction, contrast enhancement, extraction of saturation component, and noise filtering. 


2.1.1. Humination correction 

The first step in preprocessing stage is illumination correction which aims to overcome the 
non-uniform illumination in the image. This research uses the gray world assumption technique to correct 
illumination [18], [20]. The following is a mathematical representation of the gray world assumption: f (x, y) 
is an image of infected RBC by plasmodium falciparum with size M X N. f(x,y), fg Œy), and fp (x, y) are 
the red, green, and blue channels of f(x,y), respectively. The average value of each channel can be 
computed using (1)-(3). 


Fedo =e ew) () 
Fjavg = Z yzi h, y) (2) 
Fang = ple 2 ie) (3) 


In this technique, the average value of the green channel is used to compute the gain for the red and 
blue channels using (4) and (5). 


Fgavg 
= Iwg (4) 
Ir Fravg 
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Fgav 
= (5) 


Fbavg 
Subsequently, gy and gp are used to calculate the adjusted red and blue channels using (6) and (7). 
fraaj Y) = Ir X fry) (6) 
foaaj(%¥) = Ib X fo(x, y) (7) 


The image resulting from the gray world assumption is obtained by combining the fraaj (x, y), fg(x,y), and 
foaaj (x,y) channels. 
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Multiplication of segmentation result 
with the enhanced image 


Segmentation step 


Figure 4. The proposed system for classification stadium plasmodium falciparum 


2.1.2. Contrast enhancement 

Contrast enhancement is conducted to increase the contrast of the image so that the plasmodium 
parasite object is seen more clearly. Several methods for contrast enhancement have been applied in previous 
studies. Here we have considered one scan shadow compensation to improve the image’s contrast [21]. The 
approach uses a contrast stretching technique based on the image's statistical values and is applied using a 
logarithmic image processing model and recursive filtering. The method can improve low-light areas while 
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preserving colors and details and producing no visual artifacts. The algorithm consists of three steps: white 
balance compensation, shadow correction, and pixel amplification. The compensation for white balance is an 
optional step. This step adjusts the local image content based on the global intensities of the color 
components, with the green component serving as a reference. Suppose / (i,j, 1), I(i, j, 2), and I(i, j, 3) are 
the pixel located at (i,j) coordinates on each colors components of red, green, and blue, respectively. A 
recursive filter is used to calculate a running average for each color component. For each pixel at (i,j) 
coordinate, we calculate: 


RG j =BRGUj-1)+ -pIi j,1) (8) 
Gj) = BĒ(ij-— 1) + (1 -— p)I (i, j,2) (9) 
Bij) = BBCi j- 1) + (1 -— p)I (i j, 3) (10) 


In the (8)-(10), 6 is a tuning coefficient with values ranging from O to 1. Then, using the green color 
component as a reference, the correction values for each pixel in red and blue components are calculated 
using (11) and (12). 


sine, iG) (ee) 

yrs) ~ RGE) \A-a@) G6 (i,f)+255a 
7) = EED (aoB prassa) 

Ysi, j) = Bj) \A-a@)G(i,f)+255a ra 


The values for yg and ypg are limited to the range [0.95...1.05] and @ is a tuning coefficient with values 
ranging from 0 to 1. The final results of adjustment pixel values F (i,j) using white balance compensation are 
computed using (13)-(15). 


Fj, 1) = Yel (i j,1) (13) 
F(,j,2) = I(i,j,2) (14) 
FG), 3) = vel (i,j, 3) (15) 


The next step after white balance compensation is core processing called shadow correction. This 
step computes an amplification factor for each pixel that is adaptive to the average intensity of the 
neighboring pixel. The amplification factor is calculated using (16). 


Hj) =p H(ij-1)+(1-p) (a -a)+ asa) (16) 
In (16), p represents the pole of the recursive filter, and the value is in the range [0,1]. Y(i, j) is either the 
luminance of the pixel (i, j) in the YCbCr color space or the pixel average located at (i,j) from each color 
component in the RGB color space. The last step is pixel amplification using logarithmic image processing 
(LIP), as presented in (17). The use of the LIP model ensures that the range of the image components is 
preserved [22], [23]. 

3 Fijo EOD 

Fauli j,k) = M - M (1 —“C/®) (17) 
M is the maximum value of each component in the RGB or YCbCr color space. In the case of RGB images, 
the value of M is 255. k denotes the color component index, | for red, 2 for green, and 3 for blue. 


2.1.3. Extraction of saturation component 

Based on Anggraini et al. [24], HSV color space has perception above human visual, therefore has 
better performance than RGB color space. The shape of plasmodium falciparum also seems more apparent in 
the S channel [11]. In this study, the saturation component of the HSV color space will be extracted for 
further processing. HSV consists of hue, saturation, and value components. The conversion of RGB to HSV 
color space can use (18)-(20) [9]. 
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= 3(G-B) 
H = tan (Goan) (18) 
me eae min(R,G,B) 
S=1 e (19) 
y = Rete (20) 


2.1.4. Noise filtering 

The noise in the image can make the image quality low, which will also impact the accuracy of 
segmentation of the form of plasmodium falciparum in red blood cells. Filtering techniques can be used to 
remove noise in the image. Based on Devi et al. [25], [26] this study uses median filtering to remove noise 
that appears in the image of plasmodium falciparum. 


2.2. Segmentation 

Segmentation is applied to separate the parasite plasmodium falciparum from its background. The 
segmentation process is done by using Otsu thresholding. Otsu method works based on the image's pixel 
intensity to find the optimum threshold value. Iteration will be done for all the possible values and calculate 
the measure's spread for the pixel levels on each side of the threshold, i.e., the pixels that fall in the 
background or foreground. The objective is to find the threshold value where the spread of background and 
foreground summation is minimum [27]. The opening morphological operation followed by the closing 
operation is then conducted to achieve better segmentation results [28]. 


2.3. Feature extraction 

The objective of feature extraction is to get meaningful and useful information from the raw pixel 
values of an image. In this research, two types of features are combined, first is the histogram-based texture 
consists of mean, standard deviation, skewness, energy, entropy, and smoothness [11]. The second is 
morphological features, i.e., area ratio and eccentricity [12]. Mean is the average measurement of all pixel 
intensities in the image, which can be computed using (21): 


mean = Yili. p(i) (21) 
where i is the grayscale value, p(i) is the probability of i in the image, and L is the maximum grayscale 


value. Standard deviation is the variation measurement of the image's pixel intensities, which is calculated by 
(22), where y is the mean value. This feature gives the measure of the contrast. 


standar deviation = JYi-3G - u)? pW) (22) 


Energy is the measurement of pixel intensities distribution with grayscale range value, energy is the 
uniformity in an image and can be calculated by (23). 


energy = Xim [P ©]? (23) 
Skewness is the asymmetry measurement of the pixel values toward the mean. The negative value indicates 


that the intensity distribution is leaning to the left, whereas the positive value indicates that the intensity 
distribution is leaning to the right. Skewness can be calculated by (24). 


skewness = Ņt-&(i — p’p(Ù (24) 
Entropy indicates the level of image complexity. High complexity images will have high entropy values too, 


and entropy also shows the amount of information contained in the data distribution. Entropy can be 
calculated by (25). 


entropy = — Yi-9p(i)log2 (pW) (25) 
Smoothness measures the level of smoothness or roughness of image intensity, calculated by (7), where o is 


the standard deviation. The low value of smoothness indicates the image has a roughness of intensity. 
Smoothness can be calculated by (26). 
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1 


smoothness = 1- —> 
1+0 


(26) 
Area ratio is the ratio between the number of pixels that form an object and the number of overall pixels of an 
image. Eccentricity is the comparison between the length of minor and major axes, eccentricity can be 
calculated by (27) and illustrated in Figure 5. 


2 
eccentricity = |1 -— (?) (27) 


a 


Figure 5. Illustration of eccentricity 


2.4. Classification 

In this study, artificial neural network (ANN) is used to classify the input image into four classes, 
i.e. ring, trophozoite, schizont, and gametocyte classes. The selection of ANN is based on previous research, 
that ANN provides the best accuracy compared to other methods such as naive Bayes, logistic regression, 
classification and regression tree, SVM, and KNN [19], [25], [29]. The built ANN architecture consists of 
three parts, namely input, hidden, and output layers, as shown in Figure 6. 


Input unit Hidden unit Output unit 


Input: texture and 
morphological 
features of 
plasmodium 


Output: 
1000 = Ring 


0100 = Trophozoite 
0010 = Schizont 
0001 = Gametocyte 


falciparum 


Figure 6. ANN architecture 


In this study, only one hidden layer is used. The use of one hidden layer is sufficient to estimate the 
continuous mapping from the input pattern to the output pattern until the classification results are obtained 
[30]. The input for ANN is the value of each feature from the feature extraction process. The number of 
features used will determine the number of neurons in the input layer, while the number of neurons in the 
hidden layer is calculated based on (28) [31]. 


H = J(m+2)N +2,/N/(m + 2) (28) 


In (28), H states the number of hidden nodes in the hidden layer, N is the number of nodes in the input layer, 
and m is the number of nodes in the output layer. In the output layer, the number of neurons used is equal to 
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the number of classes that are the output of the classification process. The performance of the classification 
tasks will be measured with its accuracy, sensitivity, and specificity. 


3. RESULTS AND DISCUSSION 

In the preprocessing step, the input is the RGB image, as shown in Figure 3. The preprocessing 
process begins with illumination correction, contrast enhancement, extraction of saturation component, and 
the last is noise reduction using median filtering. Figure 7 shows the resulting image of the illumination 
correction using the gray world assumption for the 7(a) ring, 7(b) trophozoite, 7(c) schizont, and 7(d) 
gametocyte stages of plasmodium falciparum. 


Figure 7. The resulting image of illumination correction (a) ring, (b) trophozoite, (c) schizont, and 
(d) gametocyte 


eS 


p a 


It can be seen that the illumination corrected image has a more uniform illumination between one 
image and another, as shown in Figures 7(a)-(d). Images with uniform illumination can make determining the 
threshold in the segmentation process more straightforward, and the texture feature extraction process 
becomes more objective than the non-uniform illumination image. Next, the contrast enhancement is 
performed using the one scan shadow compensation method. This study used the value of p = 0.125 and 
a = 0.125 to calculate the amplification factor. If p > 0.5, visible artifacts can appear in high contrast areas, 
and if a > 0.25, noise becomes visible in low-quality images [21]. Figure 8 shows the amplification factor 
map generated from Figures 7(a)-(d). Amplification factor maps for the ring, trophozoite, schizont, and 
gametocyte are shown in Figures 8(a)-(d), respectively. Figure 9 shows the contrast enhancement results for 
the ring, trophozoite, schizont, and gametocyte in Figures 9(a)-(d), respectively. 


(a) (b) (c) (d) 


Figure 8. The amplification factor map (a) ring, (b) trophozoite, (c) schizont, and (d) gametocyte 


Figure 9. The resulting image of contrast enhancement (a) ring, (b) trophozoite, (c) schizont, and 
(d) gametocyte 
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In Figure 8, it can be seen that the amplification factors are adapted to each pixel based on the 
content local of the image. Using a recursive filter in amplification factor calculation makes the transition 
from one pixel to the next smoother and can reduce the artifacts [21]. Figure 10 displays histograms of the 
image before and after contrast enhancement. Figure 10(a) represents the histogram from the image in 
Figure 7(d), and Figure 10(b) represents the histogram from the image in Figure 9(d). 

In Figures 9 and 10, it can be seen that the darker areas are enhanced, so the details become more 
visible in the dark areas and maintain a near-constant intensity in lighter areas. After increasing the contrast, 
the HSV color space conversion is performed to obtain the saturation component. Figure 11 shows the result 
of HSV conversion from the RGB image. The HSV image of gametocyte plasmodium falciparum is shown in 
Figure 11(a), while the hue, saturation, and value components are shown in Figures 11(b)-(d), respectively. 
Figure 12 shows the 3D scatter plot for the HSV image of plasmodium falciparum gametocyte. 
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Figure 10. Image histogram comparison between (a) before contrast enhanced and (b) after contrast enhanced 
using shadow compensation method 


(a) (b) (c) (d) 


Figure 11. The HSV image of gametocyte plasmodium falciparum (a) HSV image, (b) hue component, 
(c) saturation component, and (d) value component 


Figure 12. 3D scatter plot for the HSV image of plasmodium falciparum gametocyte 
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By looking at Figure 11, plasmodium falciparum cells are more visible in the saturation component. 
In Figure 12, it is seen that the plots on the graph lie in a small range along the saturation axis. Based on the 
results of this experiment, the saturation component is selected for the following process. The last step of the 
preprocessing stage is the use of median filtering to remove noise. In this study, the filter size used is 3x3. 
The use of a larger filter size can make the image blur. The filtered image will be input for the segmentation 
stage, which consists of steps, conversion to a binary image, morphological operations, and multiplication 
with the contrast-enhanced image, as shown in Figure 13. 

Figure 13(a) is the input for the segmentation process. The result of binary conversion using Otsu 
thresholding still leaves a hole in the plasmodium object, as shown in Figure 13(b). Therefore, a 
morphological closing operation is performed to close the hole in the object. A morphological opening 
operation is also carried out if the image contains small objects other than plasmodium. The result of the 
morphological operation is presented in Figure 13(c). The result segmentation process was obtained by 
multiplying the binary image in Figure 13(c) with the enhanced image in Figure 9(d). Figure 13(d) shows the 
final output of the segmentation process. 

The image resulting from the segmentation process will be the input for the feature extraction stage. 
The extracted texture features are mean, standard deviation, skewness, energy, entropy, and smoothness [11], 
while the extracted morphological features are area ratio and eccentricity [12]. Figure 14 shows the values for 
each feature extracted from the image of plasmodium falciparum in gametocyte stadium. 


lIr 


(a) (b) (c) (d) 


Figure 13. Segmentation process (a) filtered image, (b) binary conversion, (c) morphological operation, and 
(d) the final segmentation result 


Mean 88.390518 

Standard deviation 24.649282 
Skewness 0.511578 

Energy 0.013027 

Entropy 4.481055 
Smoothness 0.998357 

Area ratio 0.113168 
Eccentricity 0.574029 


Figure 14. The values for each extracted feature from the plasmodium falciparum gametocyte image 


The next step is the classification of plasmodium falciparum into the ring, trophozoite, schizont, and 
gametocyte classes. Two processes are carried out at the classification stage, namely training and testing the 
built model. From a total of 250 image datasets, it is divided into training data of 175 images and testing data 
of 75. The first model uses texture features from research [11], the second model uses morphological features 
from research [12], and the third is the proposed model by combining texture and morphological features. 
The number of hidden nodes in the hidden layer is obtained based on (28). Table 1 shows the three 
architectures of the built ANN model. The parameters used in the training process are the learning rate 0.10, 
the momentum 0.2, and the number of epochs 500. Tables 2 and 3 show the model classification performance 
with the proposed feature set and the existing feature set in [11] and [12]. 

Based on the experimental results presented in Tables 2 and 3, the use of a combination of texture 
and morphological features is proven to provide better performance when compared to using only texture or 
morphological features. The average sensitivity and specificity using a combination of texture and shape 
features give better results when compared to using only texture or morphological features. The average 
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sensitivity when using a combination of texture and morphological features is 82.18% while using only 
texture or morphological features is 71.03% and 75.87%, respectively. The average specificity when using a 
combination of texture and morphological features is 94.17% while using only texture or morphological 
features is 90.59% and 91.83%, respectively. The accuracy when using a combination of texture and 
morphological features also gives a better result, which is 82.67%, while using only texture and 
morphological features is 72.00% and 76.00%, respectively. Using a combination of texture and 
morphological features can increase accuracy by 10.67% compared to using only texture features and can 
increase accuracy by 6.67% compared to using only morphological features. 


Table 1. Comparison of the built ANN architecture 


Model Feature Number of Number of nodes 
features Input layer Hidden layer Output layer 
1. Mean, standard deviation, skewness, energy, 6 6 8 
entropy, and smoothness [11] 
2. Area ratio and eccentricity [12] 2 2 5 4 
3. Mean, standard deviation, skewness, energy, 8 8 9 4 


entropy, smoothness, area ratio, and 
eccentricity (proposed features) 


Table 2. Classification performance of the proposed and existing feature set in the previous literature 


Class Sensitivity (%) Specificity (%) 
Texture [11] Morphological [12] Proposed feature Texture [11] Morphological [12] Proposed feature 
Ring 80.95 95.24 76.19 87.04 75.93 94.44 
Trophozoite 63.16 31.58 84.21 91.07 98.21 85.71 
Schizont 60.00 86.67 73.33 93.33 95.00 98.33 
Gametocyte 80.00 90.00 95.00 90.91 98.18 98.18 
Average of all 71.03 75.87 82.18 90.59 91.83 94.17 
classes 


Table 3. Comparison of model accuracy with proposed and existing feature set 
Accuracy (%) 
Texture [11] Morphological [12] Proposed feature 
72.00 76.00 82.67 


4. CONCLUSION 

The study presented in this research focuses on identifying life stage Plasmodium falciparum 
species. The approach consists of image preprocessing using gray world assumption for illumination 
correction, shadow correction for contrast enhancement, extraction of saturation component from HSV color 
space, and median filtering. The segmentation process is applied using Otsu thresholding and morphological 
Operation on the saturation component. The use of a combination of texture and morphological features 
provides better performance on the classification results when compared to using only texture or 
morphological features. The classification performance using combination texture and morphological 
features results in an accuracy of 82.67%, a sensitivity of 82.18%, and a specificity of 94.17%. The 
development of the research is necessary to increase classification performance. The improvement can be 
made by adding other features and selecting features to filter just the relevant feature. 
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